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Objective Mild traumatic brain injury (mTBI) is frequently associated with psychiatric symptoms and cognitive dysfunction, as well 
as with the receipt of workers' compensation, as many mTBIs occur due to work- related accidents. We hypothesized that depression and 
insufficient cognitive effort mediate the relationship between sociodemographic variables and cognitive dysfunction in mTBI. 

Methods A retrospective chart review study was conducted using 115 records of patients with mTBI. Cognitive effort was measured 
based on scores on the Rey 15-Item Test. Multivariate linear regression analysis was performed to examine factors predictive of cognitive 
functions. Path analysis was subsequently performed to investigate the mediating effects of depression and cognitive effort in relation to 
receipt of workers' compensation and demographic variables. 

Results Fifteen of the 115 participants (13.0%) received failing scores on the Rey 15-Item Test, which indicated insufficient cognitive 
effort. Path analysis indicated that cognitive effort mediated the effects of age and workers' compensation on cognitive functions. 

Conclusion Given the significant mediating effects of cognitive effort on cognitive performance, it is important to address patient 
motivation and encourage mTBI patients covered by workers' compensation to perform tests with authentic effort. 
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INTRODUCTION 

Traumatic brain injury (TBI) is a common condition asso- 
ciated with substantial psychosocial and occupational impair- 
ment. According to the Centers for Disease Control and Pre- 
vention (CDC), 1.7 million people sustain a TBI in the United 
States annually.' Although the mechanism by which trauma in- 
duces neuropsychiatric symptoms is still under investigation, 
the most widely accepted explanation is that accelerating and 
decelerating physical forces result in diffuse axonal injury by 
shearing the brain parenchyma within the skuU.^ 

Mild TBI (mTBI) refers to a brief change in mental status or 
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consciousness.' It is estimated that 70-90% of TBI patients are 
classified as having mTBI."^ The term "mild" in mTBI implies 
minimal causative neuronal injury with the expectation of tem- 
porary mild symptoms and spontaneous recovery. However, 
mTBI can be a serious condition that encompasses various neu- 
ropsychiatric symptoms, such as amnesia, inattention, execu- 
tive dysfunction, headache, dizziness, and depression.*" Addi- 
tionally, although most patients with mTBI completely recover 
within 1-3 months,' some continue to experience sustained 
neuropsychiatric symptoms more than a year after injury* Sev- 
eral studies have suggested that motivation and secondary gain 
significantly influence cognitive performance in mTBI.' Pa- 
tients with mTBI also tend to complain of more subjective 
symptoms than do those with moderate or severe TBI.*''" Sub- 
jective and cognitive symptoms are more predictive of self- 
perceived symptoms 1 year post-concussion than is injury se- 
verity or sociodemographic factors.* Additionally, depression 
substantially disturbs post-concussion symptoms in mTBI." 
Taken together, this evidence supports the importance of the 
roles of psychiatric symptoms, income source (workers' com- 
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pensation or other), and cognitive effort on cognitive outcomes 
in mTBI. 

However, it remains uncertain which variables are major de- 
terminants of outcomes related to cognitive functions. It is 
known that mTBI is associated with receipt of workers' com- 
pensation and that receipt of workers' compensation seems to 
influence cognitive effort It is also plausible that depression may 
decrease motivation, decreasing cognitive effort. Therefore, it is 
important to investigate the mediating effects of these variables 
on overall cognitive fiinctioning. In this study, we conducted 
path analysis to examine the potential mediating effects of de- 
pression, compensation, and cognitive effort on the relation- 
ship between sociodemographic factors and cognitive func- 
tions, including intelligence, memory, and executive functions. 

METHODS 
Subjects 

This retrospective chart review study was conducted using 
patient records from March 2001 to March 2010. We assessed 
computerized sociodemographic and neuropsychological re- 
cords from the Traumatic Brain Injury Center at the Universi- 
ty Hospital. Patients with mTBI were included in the study 
based on medical records, and mTBI was defined, following 
the definition used by the CDC,'^ as a head injury resulting 
from non-penetrating trauma and/or swaying (accelerating 
and decelerating) forces with one or more of the following con- 
ditions attributable to the head injury during the surveillance 
period: 1) Any period of observed or self-reported transient 
confusion, disorientation, or impaired consciousness; 2) Any 
period of observed or self-reported dysfunction of memory 
(amnesia) around the time of injury; 3) Observed signs of oth- 
er neurological or neuropsychological dysfunction, such as 
seizures acutely following head injury; or 4) Headache, dizzi- 
ness, irritability, fatigue, or poor concentration identified soon 
after the injury with evidence of loss of consciousness or al- 
tered consciousness. The exclusion criteria suggested by the 
CDC were: 1) Loss of consciousness lasting longer than 30 
minutes; 2) Post-traumatic amnesia lasting longer than 24 
hours; or 3) Penetrating craniocerebral injury. This study pro- 
tocol was approved by the local Institutional Review Board 
(IRB) at Soonchunhyang University Bucheon Hospital. 

Instruments 

Cognitive effort: Rey's 15-Item Test 

Rey's 15-Item Test was initially developed to detect malin- 
gering with respect to memory fimction." During the test, pa- 
tients were instructed to look at five rows of three characters 
each, totaling 15 different items. After 10 seconds, the cards 



were withdrawn, and patients were instructed to recall and 
draw the 15 items. The score was defined as the number of 
items drawn by a patient. Because this test is easy to use and 
not time consuming, it is one of the most frequentiy used by 
neuropsychological experts in cases of workers' compensation 
and injury-related litigation." There is reasonable consensus 
that the cut-off point for insufficient cognitive effort is a score 
of eight or less.'^ 

Intelligence: Korean Wechsler Adult Intelligence 
Scale-Revised (K-WAIS-R) 

The K-WAIS-R is a standardized version of the Wechsler 
Adult Intelligence Scale translated into Korean."" It consists of 
siK verbal subtests (information, digit span, vocabulary, arith- 
metic, comprehension, and similarities) and five performance 
subtests (picture completion, picture arrangement, block design, 
digit symbol, and object assembly). The Intelligence Quotient 
(IQ) portion of the K-WAIS-R was standardized in a normal 
population to a mean of 100 with a standard deviation (SD) of 
15. IQ scores were used in the current study to represent the in- 
telligence domain of cognitive functioning in the path analysis. 

Memory: Rey-Kim memory test 

The Rey-Kim memory test evaluates both auditory and visu- 
al memory. 

Auditory memory: Rey-Kim Auditory Verbal 
Learning Test 

The Rey-Kim Auditory Verbal Learning Test (K-AVLT) is a 
modified version of the Rey Auditory Verbal Learning Test 
that was translated into Korean.'' This test consists of three 
steps. First, subjects listen to 15 consecutive words, followed 
by a free recall of the 15 words. Five of these trials are per- 
formed with the same 15 words. Second, subjects are instruct- 
ed to again recall the 15 words 20 minutes later (delayed re- 
call). Third, immediately after the delayed recall, 50 words are 
presented to patients; 15 of these are the same as those in the 
earlier trials, and subjects are instructed to select these 15 
words (delayed recognition). Scores are calculated based on 
the total number of recalled words at each trial, delayed recall, 
and delayed recognition. 

Visual memory: Rey-Kim Complex Figure Test 

The Rey-Kim Complex Figure Test (K-CFT) is a standard- 
ized Korean version of the Rey-Osterrieth Complex Figure 
Test (ROCFT)." It comprises three steps. First, patients are in- 
structed to copy a complex figure (drawing). Second, patients 
are directed to recall and draw the complex figure (immediate 
recall). Third, 20 minutes after the second step, patients are in- 
structed to draw the complex figure again (delayed recall). 
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Scores are calculated based on the form and parts of the drawn 
complex figure. 

Like IQ, the Rey-Kim memory test provides a standardized 
score, the memory quotient (MQ), which was used to represent 
the final dependent variable in the path model. 

Executive Functions: Executive Intelligence Test 

Inhibition: Stroop test 

The Stroop test consists of three trials: a word trial, a color 
trial, and a word-color interference trial'* This study used the 
translated Korean version." hi the word-naming trial, the par- 
ticipants were told to read aloud four color words printed in 
black. In the color-naming trial, the words were printed in the 
color to which they referred (i.e., word and color were congru- 
ent), and the participants were told to read the words aloud. 
Finally, in the color- word interference trial, the words were in- 
congruent with their ink color, and the participants were in- 
structed to say the name of the ink color and not read the word. 
In this study, the results were presented in terms of response 
times (i.e., the time between the presentation of the target stim- 
ulus and the response). 

Verbal fluency: Controlled Oral Word Association Test 

The Controlled Oral Word Association (COWAT) Test is a 
standardized version of a word fluency test.^° This test mea- 
sures phonemic and semantic fluencies. In the phonemic flu- 
ency test, participants are told to Ust as many words as they 
can think of that begin with the three Korean letters that re- 
semble the letters "g," "o," and "s" during three separate 1 -min- 
ute trials. In the semantic fluency test, participants are in- 
structed to produce exemplars of fruit and animal categories 
during two separate 1 -minute trials. In this study, the sum of 
the phonemic and semantic fluency scores was used to indi- 
cate verbal fluency. 

Design fluency: design fluency test 

The design fluency test used was a Korean standardized ver- 
sion of the Ruff Figural Fluency Test.^' Patients were instructed 
to connect five separate points in as many ways as possible dur- 
ing 1 minute. Total scores were calculated based on the num- 
ber of different designs made in three trials. 

The standardized score for this test, the executive intelligence 
quotient (EIQ), along with the IQ and MQ, was used in the 
path model in this study. 

Subjective psychiatric symptoms: Symptom 
Checklist 90-Revised Version 

The Symptom Checklist 90-Revised (SCL-90-R) is a 90-item, 
self-administered, multi-dimensional inventory designed to 



measure the current level of symptoms experienced by an in- 
dividual within the last 7 days.^^'^' The SCL-90-R was validated 
for a broad range of populations, including healthy people 
and those suffering with mTBI.^^'^^ Among the nine dimen- 
sions in the SCL-90-R, we used the depression subscale (13 
items) in this study. 

Statistical analysis 

Demographic and clinical data were compared to determine 
group differences after participants were divided into two 
groups: those who failed (scores of 8 or lower, indicating low 
levels of cognitive effort) and those who passed (scores of 9 or 
higher, indicating high levels of cognitive effort) the Rey 15- 
Item Test. Dichotomous variables were analyzed with chi-square 
tests, and continuous variables were analyzed using indepen- 
dent t-tests or Mann-Whitney tests, according to the normality 
of their distributions as assessed by the Shapiro-Wilk test. 

Multivariate Unear regression analysis was performed to re- 
veal the factors predictive of cognitive flinctions. Age, gender, 
education, receipt of workers' compensation, Rey 15-Item Test 
scores, imaging abnormalities (hemorrhagic contusion), and 
SCL-90-R depression scores were included. 

Path analysis was subsequently conducted to examine the 
mediating effects of depression and cognitive effort on cogni- 
tive functions. As depression can lower motivation, we set the 
SCL-90-R depression scores as the first mediating factor that 
might influence cognitive effort. All statistical analyses were 
conducted using Stata 12.1 (StataCorp LP, TX, USA). 

RESULTS 

Subjects and cognitive effort 

A total of 115 patients were included. Demographic data are 
presented in Table 1. The Rey 15-Item Test mean (SD) score 
was 11.71 (2.87). Fifteen of 115 patients (13.0%) scored 8 or 
less, and were thus classified in the failure (low cognitive ef- 
fort) group; only 36 (31.3%) patients had perfect scores. 

The relationship between cognitive effort and 
psychiatric symptoms and cognitive functioning 

Major cognitive functions, including intelligence, memory, 
and executive functions, and depression were analyzed accord- 
ing to whether subjects had passed or failed Rey's 15-Item Test 
(Table 2). The group that failed (low cogrutive effort) had sig- 
nificantiy lower scores on most of the cognitive tests address- 
ing intelligence, memory, and executive fiinctions as compared 
with the group that passed (high cognitive effort). There were 
no significant differences in depression severity between the 
two groups, and no significant differences in cognitive and psy- 
chiatric symptoms between patients with and without imaging 
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Table 1. Demographic and clinical data of patients with mild trau- 
matic brain injury (N=115) 



Variable Mean (SD) or number (%) 



Age 




40.8 (12.5) 


Gender (male) 




89 (77.4) 


Education (year) 




10.9 (3.4) 


Time since injury (month) 


10.6 (7.2) 


Compensation 






Workers' compensation 


35 (30.4) 


Others 




80 (69.6) 


Abnormalities in MRI 




52 (45.2) 


Rey 15 -item test scores 




11.7(2.9) 


AH data were presented 


as mean (SD) or 


number (%). MRI: mag- 


netic resonance imaging 






Table 2. Comparison of cognitive function and psychiatric symp- 


toms between pass and failure groups in Rey 15-ltem Test 




Rey 15-ItemTest 


Variable 


Failure (N=15) 


Pass (N=100) p value 




Mean (SD) 


Mean (SD) 


Intelligence 






IQ 


86.8 (10.2) 


95.0(12.5) 0.02 


VIQ 


90.6 (9.9) 


96.4(12.7) 0.10 


PIQ 


82.9(11.1) 


93.6(13.0) <0.01 


EIQ 


70.7(17.7) 


85.2 (19.4) 0.01 


MQ 


80.3 (18.9) 


95.5 (14.9) <0.01 


SCL-90-R depression 


69.3 (18.6) 


62.7(13.0) 0.26 



IQ: intelligence quotient, VIQ: verbal intelligence quotient, PIQ: 
performance intelligence quotient, EIQ: executive intelligence 
quotient, MQ: memory quotient, SCL-90-R: Symptom Checklist 
90-Revised version 



abnormalities were observed (data not shown). 

Multivariate linear regression analysis 

Separate multivariate linear regression analyses were con- 
ducted for intelligence, memory, and executive functions (Ta- 
ble 3). Cognitive effort was a common risk factor for all three 
cognitive components. Depression had an inverse influence 
on intelligence but not on memory or executive fimctions. Age 
had a positive influence on intelligence and memory. 

Path model for the mediating effects of cognitive 
effort and depression on cognitive performance 

The path model showed satisfactory results for goodness-of- 
fit: root mean squared error of approximation (RMSEA) =0.002, 
comparative fit index (CFI)=1.000, Tucker-Lewis index 
(TLI)=1.000, and standardized root mean squared residual 
(SRMR)=0.056. The direct and indirect effects of demographic 
and clinical variables with a standardized coefficient (3 are pre- 
sented in Figure 1. Age had both direct and indirect effects on 



Table 3. Multiple linear regression analysis for intelligence, mem- 
ory, and executive function 



IQ MQ EIQ 





P 


P 


P 


P 


P 


P 


Age 


0.44 


<0.01 


0.42 


<0.01 


0.19 


0.12 


Gender 


0.03 


0.79 


-0.15 


0.13 


-0.16 


0.11 


Education (year) 


-0.06 


0.58 


-0.10 


0.33 


-0.05 


0.62 


Compensation 


-0.02 


0.81 


0.00 


0.97 


-0.09 


0.41 


Imaging 


-0.05 


0.61 


0.07 


0.50 


0.15 


0.14 


Rey 15 -Item 


0.49 


<0.01 


0.53 


<0.01 


0.45 


<0.01 


SCL-90-R depression 


-0.23 


0.05 


-0.11 


0.34 


-0.08 


0.48 



IQ: intelligence quotient, MQ: memory quotient, EIQ: executive 
intelligence quotient, SCL-90-R: Symptom Checklist 90-Revised 
version. Reference values: gender=female, compensation=non- 
workers' compensation, imaging=non- abnormal findings on mag- 
netic resonance imaging 



0.35' 




Figure 1. Final path model for cognitive function in patients with 
mild traumatic brain injury. *p<0.05, tp<0.01, *p<0.001. 

intelligence scores. Whereas age had positive direct influences 
on intelligence and memory, it had negative indirect effects on 
cognitive functions, through cognitive effort. Consequently, 
the total effect of age on intelligence ((5=0.05, p=0.577) and 
memory ((3=0.05, p=0.598) was small and not significant. The 
total effect of age on executive functions was negative ((3=-0.22, 
p<0.001). Workers' compensation had only an indirect effect 
on cognitive fimctions, through cognitive effort. The total ef- 
fects of workers' compensation on each examined cognitive 
function were significant and negative: intelligence ((3=-0.10, 
p=0.034), memory ((3=-0.11, p=0.032), and executive functions 
((3=-0.08, p=0.038). The total effect of education on intelligence 
was not significant ((3=-0.04, p=0.139). Gender and abnormal 
imaging findings had no direct or indirect effects on cognitive 
functions. Contrary to our a priori hypothesis, depression had 
no causative role in cognitive effort 

DISCUSSION 

The primary purpose of this study was to examine the po- 
tential mediating effects of depression and cognitive effort on 
cognitive fimctions in patients with mTBI. Our results demon- 
strate that only cognitive effort had significant mediating ef- 
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fects on intelligence, memory, and executive functions. De- 
pression had no causative relationship with cognitive effort, 
whereas workers' compensation did have a significant negative 
efiect on cognitive effort, although the magnitude was modest. 
These results suggest that cognitive fimctioning in mTBI seems 
to be significantly influenced by external factors such as work- 
ers' compensation and insufficient effort. 

As Rey's 15-Item Test is a type of cognitive test, one might ar- 
gue that the positive relationship between this memory test and 
other cognitive tests is inevitable. However, as described in the 
Methods section, the level of difficulty of Rey's 15-Item Test is 
extremely low. A previous study demonstrated that even pa- 
tients with severe TBI could attain a perfect score (IS).^*" Hence, 
in general, Rey 15-Item Test scores should show a strong nega- 
tive skew, reflecting a ceiling effect. However, the distribution 
of scores in our study was not skewed, and only 36 of 115 
(31.3%) patients had perfect scores. Thus, the results suggest 
that a substantial proportion of our participants did not do 
their best on the cognitive test. 

It is noteworthy that depression had no causative influence 
on cognitive effort. These results suggest that the degree to 
which patients with mTBI exerted effort would be more plau- 
sibly attributed to external factors, such as compensation, rath- 
er than to intrinsic factors, such as depression. Additionally, 
most cognitive function test results are more strongly associat- 
ed with cognitive effort than with severity of depression, which 
also supports the undue influence of external factors on the 
cognitive performance in patients with mTBI. On the other 
hand, the mean severity of depression in our sample was above 
60T, which is higher than normal. Depression is a prevalent 
psychiatric symptom in mTBI, possibly due to neural impair- 
ments, including catecholamine dysregulation^' and neuro- 
anatomical changes."* Although depression was not signifi- 
cantly associated with cognitive functions or efforts, as was 
compensation, careful evaluation and management are needed 
to prevent the development of depressive disorders. 

Another interesting finding in our study was the relationship 
between workers' compensation and cognitive effort. Workers' 
compensation had indirect negative effects on intelligence, 
memory, and executive functions, through insufficient cogni- 
tive effort. This is consistent with findings that malingering or 
intentional cognitive underperformance were most common 
in workers' compensation cases (30.12%), followed by person- 
al injury cases (28.66%), criminal cases (19.25%), and medical 
or psychiatric cases (8.11%), categorized according to referral 
type.^' Specifically, these patterns of exaggeration or cognitive 
underperformance were considered the most pronounced in 
patients with mild head injury. Although several previous mTBI 
studies have regarded patients seeking compensation as one 
group,^"'^' we examined differences between those receiving 



workers' compensation and others as we thought that workers' 
compensation would be more strongly related to secondary 
gain. Medical care costs and disability benefits might be simi- 
lar between those receiving workers' compensation and others, 
but workers' compensation also covered injury-related off- 
work costs. For example, in Korea, temporary disability bene- 
fits corresponding to 70% of average daily wages are paid to a 
worker with work-related injuries for off- work days (4 days or 
longer) during treatment.'^ 

Finally, age had positive direct effects and negative indirect 
effects on intelligence and memory, which consequently led to 
non-significant total effects. Age only had indirect effects on 
executive functions. Executive functioning was the only cogni- 
tive domain exclusively mediated by cognitive effort. As execu- 
tive functions organize various cognitive functions to perform 
goal-directed activities, it has been suggested that cognitive ef- 
fort is closely related to executive functions in mTBI.'' Gener- 
ally, age is associated with worse psychosocial and cognitive 
functioning. Several studies have reported that patients with 
traumatic brain injury had worse psychosocial and cognitive 
fimctioning as a function of age.'*"" Those findings seem con- 
trary to our findings suggesting that intelligence and memory 
functions were positively associated with ageing. The discrep- 
ancy might arise from the use of different measures. Whereas 
previous studies measured the outcomes several years to de- 
cades after injury, the mean post-injury period of our sample 
was about 10 months. Another possible reason is individual 
differences in the relationship between ageing and cognitive 
functions. Recent studies have suggested that individual differ- 
ences in genetic profiles influence intelligence across the Ufes- 
pan."* 

There are several limitations to this study. First, we could not 
compare neuropsychological tests between compensation and 
non-compensation groups. We would need to assess patients 
with mTBI who are not seeking compensation for their inju- 
ries to more accurately evaluate the role of compensation. 
However, in Korea, 92.5% of adults over 20 years old are cov- 
ered by one or more types of private insurance,'^ so there are 
very few patients for whom compensation is irrelevant. Addi- 
tionally, because most of the patients in this study were re- 
ferred for neuropsychological tests, we could not confirm their 
medical status at the initial period of injury. In the same man- 
ner as in several previous studies," identifying ratings on the 
Glasgow coma scale was difficult due to lack of information 
from the ambulance service or the emergency department. To 
minimize selection bias, we comprehensively reviewed the re- 
cords and included only those patients who were strongly sug- 
gested to have mTBI based on the definition recommended by 
the CDC.'^ Finally, the relatively large proportion (52/115, 
45.2%) of abnormal MRI findings in our sample should be 
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noted. This proportion of abnormal imaging findings is higher 
than that reported in previous studies, where it ranged from 
16% to 32%.'"*''' We speculate that this is due to the character- 
istics of our sample. As our subjects were referred to our hos- 
pital for comprehensive cognitive testing, complicated cases 
were more frequent than it was in other samples. The high 
prevalence of abnormal imaging findings was not associated 
with psychiatric symptoms or cognitive domains, which is con- 
sistent with previous studies.'*" 

Conclusions 

In summary, this study demonstrates that insufficient cogni- 
tive effort is a strong mediating factor for various cognitive 
functions in mTBI, including intelligence, memory, and execu- 
tive functions. Additionally, patients receiving workers' com- 
pensation showed significantly less cognitive effort than oth- 
ers. Our results revealed that clinicians who evaluate and 
manage patients with mTBI often feel that those patients might 
not do their best in tests of cognitive functions. We believe that 
our results will be helpful in clinical practice with regard to 
evaluating and interpreting the results obtained by patients 
with mTBI on cognitive tests. Health professionals should en- 
courage patients with mTBI to perform cognitive tests with suf- 
ficient effort. 
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